基于GPU加速的Boussinesq类波浪传播变形数值模型

Boussinesq波浪模型是一类相位解析模型,在时域内求解需要较高的空间和时间分辨率以保证计算精度。为提高计算效率,有必要针对该类模型开展并行算法的研究。与传统的中央处理器(CPU)相比,图形处理器(GPU)有大量的运算器,可显著提高计算效率。基于统一计算设备架构CUDA C语言和图形处理器,实现了Boussinesq模型的并行运算。将本模型的计算结果同CPU数值模拟结果和解析解相比较,发现得到的结果基本一致。同时也比较了CPU端与GPU端的计算效率,结果表明,GPU数值模型的计算效率有明显提升,并且伴随数值网格的增多,提升效果更为明显。     

A hierarchical indexing strategy for optimizing Apache Spark with HDFS to efficiently query big geospatial raster data

ABSTRACT

Earth observations and model simulations are generating big multidimensional array-based raster data. However, it is difficult to efficiently query these big raster data due to the inconsistency among the geospatial raster data model, distributed physical data storage model, and the data pipeline in distributed computing frameworks. To efficiently process big geospatial data, this paper proposes a three-layer hierarchical indexing strategy to optimize Apache Spark with Hadoop Distributed File System (HDFS) from the following aspects: (1) improve I/O efficiency by adopting the chunking data structure; (2) keep the workload balance and high data locality by building the global index (k-d tree); (3) enable Spark and HDFS to natively support geospatial raster data formats (e.g., HDF4, NetCDF4, GeoTiff) by building the local index (hash table); (4) index the in-memory data to further improve geospatial data queries; (5) develop a data repartition strategy to tune the query parallelism while keeping high data locality. The above strategies are implemented by developing the customized RDDs, and evaluated by comparing the performance with that of Spark SQL and SciSpark. The proposed indexing strategy can be applied to other distributed frameworks or cloud-based computing systems to natively support big geospatial data query with high efficiency.     

New formulae for capacity energy-based assessment of liquefaction triggering

Abstract

Liquefaction of loose saturated soil deposits is a hazardous type of ground failure occurring under earthquake excitations. Therefore, an accurate estimation of liquefaction potential is extremely important in geotechnical engineering. In the current study, a new model is proposed which estimates the level of strain energy needed for liquefaction initiation. A compiled database containing cyclic tests gathered from previously published works was used to develop new models to predict liquefaction potential. M5′ algorithm was used to find the best correlation between parameters. It was shown that not only the derived formulas are acceptably accurate but also they feature a very simple structure in comparison with available formulas in the literature. The proposed equations are accurate, physically sound and uncomplicated. Furthermore, safety factors were given for different levels of risk, which can be useful for engineering practice. In addition, the influence of different predictors on the liquefaction potential was evaluated and also the significance of input variables was assessed via sensitivity analysis. Finally, a new model was introduced for preliminary estimation of liquefaction potential.     

GIS典型几何计算算法的并行化及优化研究

空间数据规模的快速增长对传统矢量数据分析方法提出了更高的计算效率和处理规模要求。随着计算机硬件和软件技术的进步,并行计算为提高GIS中典型几何计算算法的计算效率、扩大问题处理规模提供了有效手段。本文在Visual Studio 2010中,使用标准C++编程语言,基于GDAL(Geospatial Data Abstraction Library)库实现空间数据的读写操作,针对线简化算法的并行化问题,在高性能计算环境下对并行任务调度策略、并行计算粒度、数据分解方法等多个核心内容开展研究。在完成相关串行算法的基础上,实现了该算法的并行化和优化设计,为相关的矢量数据空间分析方法的多核并行优化提供了思路和参考。     

地理要素的分布式空间近似查询处理方法

针对传统空间查询无法满足地理数据交互式可视化对处理时间要求的问题,以窗口查询为例,提出了一种空间近似查询处理方法。该方法包括预处理和查询两步:在预处理阶段,利用分布化的线简化算法对空间对象进行顾及误差的预处理采样,将采样过程及误差值用树型结构保存;在查询阶段,以豪斯多夫距离定义数据可视化的误差,进行误差可知的顶点即时采样与截取,从而实现针对可视化应用的高效的空间近似查询处理。在Hadoop集群上利用77GB的OpenStreetMap数据集进行了实验,证实了本方法的效力与效率。     

A high-performance cellular automata model for urban simulation based on vectorization and parallel computing technology

Cellular automata (CA) models can simulate complex urban systems through simple rules and have become important tools for studying the spatio-temporal evolution of urban land use. However, the multiple and large-volume data layers, massive geospatial processing and complicated algorithms for automatic calibration in the urban CA models require a high level of computational capability. Unfortunately, the limited performance of sequential computation on a single computing unit (i.e. a central processing unit (CPU) or a graphics processing unit (GPU)) and the high cost of parallel design and programming make it difficult to establish a high-performance urban CA model. As a result of its powerful computational ability and scalability, the vectorization paradigm is becoming increasingly important and has received wide attention with regard to this kind of computational problem. This paper presents a high-performance CA model using vectorization and parallel computing technology for the computation-intensive and data-intensive geospatial processing in urban simulation. To transfer the original algorithm to a vectorized algorithm, we define the neighborhood set of the cell space and improve the operation paradigm of neighborhood computation, transition probability calculation, and cell state transition. The experiments undertaken in this study demonstrate that the vectorized algorithm can greatly reduce the computation time, especially in the environment of a vector programming language, and it is possible to parallelize the algorithm as the data volume increases. The execution time for the simulation of 5-m resolution and 3 × 3 neighborhood decreased from 38,220.43 s to 803.36 s with the vectorized algorithm and was further shortened to 476.54 s by dividing the domain into four computing units. The experiments also indicated that the computational efficiency of the vectorized algorithm is closely related to the neighborhood size and configuration, as well as the shape of the research domain. We can conclude that the combination of vectorization and parallel computing technology can provide scalable solutions to significantly improve the applicability of urban CA.     

融合多模态特征的社会多媒体谣言检测技术研究

以微博为代表的社会媒体的蓬勃发展在加速信息交流的同时,也促使虚假谣言信息迅速在社会网络上传播,造成严重的后果.自动谣言检测问题受到了国内外学术界、产业界的广泛关注.围绕社会多媒体谣言检测这一问题,本文总结了融合多模态特征的谣言检测相关技术.首先从基本概念出发,阐述了谣言的定义和社会多媒体的特点,给出了社会多媒体谣言检测问题的定义.针对谣言检测面临的多模态特征抽取和模型构建两大难点,分别总结和归纳了各种类型的特征及其提取方法和不同的机器学习检测模型.这些特征和算法是检测谣言的基本手段,也是接下来研究的基础,可为进一步谣言检测的研究提供参考.     

球谐分析及合成并行计算

本文介绍了球谐合成和分析问题的数值计算原理,研究分析了其内在的并行性,提出了区域划分和聚合通信的并行计算策略。基于傅立叶变换技术,应用MPI(消息传递接口)并行编程模式,实现了球谐分析及合成计算的并行化。实验结果表明,较之串行实现,并行实现大大缩短了计算时间,获得了近似线形加速比,取得很高的并行效率。     

多边形叠加Vatti算法的VCS优化方法与GPU并行化

Vatti算法是常用的矢量多边形裁剪算法之一,在其构建扫描束实现交点计算的过程中,二叉树的数据结构和递归计算方法导致其计算效率受矢量多边形边界顶点数量影响显著。本文针对Vatti算法执行过程中较为耗时的扫描束构建环节,提出了一种多边形边界顶点预排序的优化方法——VCS（Vertex Coordinate Pre-Sorting）方法,并基于该方法实现了对Vatti算法的GPU细粒度并行化。VCS方法使用双向链表对Vatti算法原有的二叉树数据结构进行了替换,以较小的额外存储空间取得了多边形边界顶点信息查找效率的明显提升。在GPU环境下采用双调排序算法对多边形边界顶点数组元素进行并行化排序并过滤出有效值,克服了原始算法使用二叉树存储导致效率低下的问题。实验结果表明,改进后的算法与原始算法相比,具有相同的计算精度;当多边形顶点数量为92万,CUDA每个线程块中的线程数量为32时,使用VCS优化方法,与采用CPU计算构建扫描束方法相比,GPU并行化方法获得了39.6倍的相对加速比,矢量多边形叠加分析算法效率总体上提升了4.9倍。     

面向大规模空间Agent建模的分布式地理模拟框架

基于Agent建模的地理模拟是认识和理解动态地理现象的有效方法,但随着地理模拟的规模和复杂性不断增加,模型的计算问题开始凸显。分布式并行仿真是解决大规模Agent复杂模拟计算的途径,然而已有研究基于Agent建模/仿真软件构建并行仿真系统的方式并不适用于具有高移动与行为交互的空间Agent建模及其模拟过程的实时可视化。为解决这个问题, 本文提出了一个分布式地理模拟框架DGSimF,用于大规模动态空间Agent模拟,支持模拟过程的实时表示与分析。设计了一个简单但高效的时空数据模型建模空间Agent,支持直接基于Agent行为建模集成地学模型,采用了时间微分方法协同各计算节点行为的执行,实现以“任务并行”的方式进行分布式计算以提高仿真性能,构建了基于三维地球渲染引擎的虚拟地理环境,提供模拟过程的实时可视化。最后,以“红蓝对抗”案例进行了实验验证,对不同模拟计算量和不同客户端数量下的仿真性能进行了分析,结果表明DGSimF可以为具有时空特征变化与行为交互的大规模空间Agent模拟提供一个有效的平台。通过扩展计算节点,DGSimF可以有效地缓解复杂模拟计算的压力问题,并且仿真性能较高,在实验中并行效率保持在0.7以上。